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Abstract 

In the Densest fc-Subgraph problem, given a graph G and a parameter one needs to find 
a subgraph of G induced on k vertices that contains the largest number of edges. There is a 
significant gap between the best known upper and lower bounds for this problem. It is NP-hard, 
and does not have a PTAS unless NP has subexponential time algorithms. On the other hand, 
the current best known algorithm of Feige, Kortsarz and Peleg IF KI'Oll. gives an approximation 
ratio of n 1 / 3-6 for some specific e > (estimated by those authors at around e — 1/60). 

We present an algorithm that for every e > approximates the Densest fc-Subgraph problem 
within a ratio of n 1 / 4+£ in time n ' 1 ^'. If allowed to run for time n°^° gn \ our algorithm 
achieves an approximation ratio of (^(n 1 / 4 ). Our algorithm is inspired by studying an average- 
case version of the problem where the goal is to distinguish random graphs from random graphs 
with planted dense subgraphs - the approximation ratio we achieve for the general case matches 
the "distinguishing ratio" we obtain for this planted problem. Achieving a distinguishing ratio 
of o(n 1 / 4 ) for the planted problem (in polynomial time) is beyond the reach of our current 
techniques. 

At a high level, our algorithms involve cleverly counting appropriately defined trees of con- 
stant size in G, and using these counts to identify the vertices of the dense subgraph. Our 
algorithm is based on the following principle. We say that a graph G(V 1 E) has log-density a if 
its average degree is 8(| V| a ). The algorithmic core of our result is a family of algorithms that 
output fc-subgraphs of nontrivial density whenever the log-density of the densest fc-subgraph is 
larger than the log-density of the host graph. 

Finally, we extend this algorithm to obtain an 0(n 1 / 4-£ )-approximation algorithm which 
runs in time 0(2 n< ( ) and also explore various approaches to obtain better approximation 
algorithms in restricted parameter settings for random instances. 
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1 Introduction 



In this paper, we study the Densest /c-Subgraph (DkS) problem: Given a graph G and parameter 
k, find a subgraph of G on k vertices with maximum density (average degree). This problem may 
be seen as an optimization version of the classical NP-complete decision problem CLIQUE. The 
approximability of DkS is an important open problem and despite much work, there remains a 
significant gap between the currently best known upper and lower bounds. 

In addition to being NP-hard (as seen by the connection to CLIQUE), the DkS problem has also 
been shown not to admit a PTAS under various complexity theoretic assumptions. Feige [Fei02j 
has shown this assuming random 3-SAT formulas are hard to refute, while more recently this 
was shown by Khot [KhoQ4] assuming that NP does not have randomized algorithms that run in 
sub-exponential time (i.e. that NP % r\ £>0 BPTIME(2 nE )). 

The current best approximation ratio of n l l^~ £ for some small e > (which has been esti- 
mated to be roughly 1/60) was achieved by Feige, Kortsarz and Peleg [FKPOlJ. Other known 
approximation algorithms have approximation guarantees that depend on the parameter k. The 
greedy heuristic of Asahiro et al. [AHI02J obtains an 0{n/k) approximation. Linear and semidefi- 
nite programming (SDP) relaxations were studied by Srivastav and Wolf [SW98] and by Feige and 
Langberg [FL01| . where the latter authors show how they can be used to get approximation ratios 
somewhat better than n/k. Feige and Seltser [FS97] show graphs for which the integrality gap of 
the natural SDP relaxation is f^n 1 / 3 ), indicating that in the worst case, the approximation ratios 
achieved in [FKP01 are better than those achievable by this SDP. When the input is a complete 
graph with edge weights that satisfy the triangle inequality, a simple greedy algorithm achieves an 
approximation ratio of 2 (though the analysis of this algorithm is apparently not easy, see [BG09]). 

A related problem to DkS is the max density subgraph problem, where the aim is to find a 
subgraph H which maximizes the ratio of number of edges to number of vertices in H. It turns 
out that this can be solved in polynomial time [GGT89j . Charikar et al. [CHK09] recently showed 
an 0(n x / 3 ) approximation to the maximization version of label cover. This problem is at least as 
difficult as DkS in the sense that there is an approximation preserving randomized reduction from 
DkS (see j('IIK()9| for example) to it. No reduction in the opposite direction is known. 

Our algorithm for DkS is inspired by studying an average-case version we call the 'Dense vs 
Random' question (see Section [3] for a precise definition) . Here the aim is to distinguish random 
graphs from graphs containing a dense subgraphs, which can be viewed as the task of efficiently 
certifying that random graphs do not contain dense subgraphs. This distinguishing problem is 
similar in flavour to the well-studied planted clique problem (see [AKS98J). Getting a better 
understanding of this planted question seems crucial for further progress on DkS. 

Some recent papers have used the hypothesis that (bipartite versions of) the planted dense 
subgraph problem is computationally hard: Applebaum et al. [ABW08] use this in the design of a 
new public key encryption scheme. More recently, Arora et al. [ABBG10J use this to demonstrate 
that evaluating certain financial derivatives is computationally hard. The use of such hardness 
assumptions provides additional motivation for the study of algorithms for these problems. 

1.1 Our results 

Our main result is a polynomial time 0(n 1//4+e ) approximation algorithm for DkS, for any constant 
e > 0. That is, given e > 0, and a graph G with a A;-subgraph of density d, our algorithm outputs 
a /c-subgraph of density f2 (d/n 1 / 4 " 1 " 5 ) in polynomial time. In particular, our techniques give an 
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0(n 1 / 4 )-approximation algorithm running in 0(n logn ) time. 

At a high level, our algorithms involve cleverly counting appropriately defined subgraphs of 
constant size in G, and use these counts to identify the vertices of the dense subgraph. A key 
notion which comes up in the analysis is the following: 

Definition 1.1. The log-density of a graph G(V,E) with average degree D is logiyi D. In other 
words, if a graph has log-density a, its average degree is \V\ a . 

We first consider the random setting - distinguishing between G drawn from G(n,p), and G 
containing a /c-subgraph H of certain density planted in it. In fact, we examine a few variants (i.e. 
in the second case each of G and H may or may not be random). For all these variants we show 
that if the log-density of G is a and that of H is /3, with (3 > a, we can solve the distinguishing 
problem in time n°^ l /^~ a ^ . 

Our main technical contribution is that a result of this nature can be proven for arbitrary 
graphs. Informally, our main result, which gives a family of algorithms, parametrized by a rational 
number r/s, can be stated as follows (see Theorem 14.51 for a more precise statement): 

Theorem 1.2. (informal) Let s > r > be relatively prime integers, let G be an undirected graph 
with maximum degree D = n r l s , which contains a k-subgraph H with average degree d. Then there 
is an algorithm running in time that finds a k-subgraph of average degree tt(d/D( s ~ r ^ s ) . 

Note that the log-density of H does not explicitly occur in the statement of the theorem. 
However, it turns out we can pre-process the graph, and restrict ourselves to the case kD = n (see 
Appendix I A. 2 j) . in which case Z)( s ~ r )/ S = k r l s , thus the output subgraph has average degree djk r l s . 
So if the log-density of H is (3 (recall that G has log-density < r/s), the output graph has density 
d/k r l s = k^~ r l s . Thus the difference in the log-densities also plays a role in the case of arbitrary 
graphs. 

Also note that the theorem deals with the maximum degree in G, and not average degree (which 
defines the log-density). It turns out that this upper-bound on the log-density will suffice (and will 
be more useful in the analysis). 

As we observed earlier, we give a family of algorithms parameterized by a rational number. 
Thus, given G and k, we pick r/s appropriately and appeal to the theorem. In some sense, this 
family of algorithms is a systematic generalization of the (somewhat ad hoc) algorithms of [FKPOlJ. 

Finally, observe that theorem implies an approximation ratio of at most Z)( s-r )/ s < rf^ s ~ T ^ s < 
ra 1 / 4 for every choice of s > r > 0. As we mentioned, the statement above is informal. If we choose 
to restrict the running time to O(n so ) by limiting ourselves to r < s < so (i.e. the bound on D will 
not be exact), we lose a factor n 1//s ° in the approximation. We refer to Section H] for the details. 

Outline of techniques. The distinguishing algorithm for the Dense vs Random problem is based 
on the fact that in G{n,p), instances of any fixed constant size structure appear more often when 
the graph has a higher log-density. More precisely, given parameters r,s, we will define a (constant 
size) tree T T)S such that a fixed set of leaves can be completed to many instances of T rs in a graph 
with log-density > r/s, whereas in a random graph with log-density < r/s there will only be a 
negligible number of such instances. Thus, if the log-density of H is greater than r/s, finding a 
small set of vertices in H (and using them as leaves of T r ^ s ) can help reveal larger portions of a dense 

1 We will ignore low order terms when expressing the log-density. For example, graphs with constant average 
degree will be said to have log-density 0, and cliques will be said to have log-density 1. 
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subgraph. Though our intuition comes from random graphs, the heart of the argument carries over 
to worst-case instances. 

We use a linear programming relaxation to guide us in our search for the fixed vertices' assign- 
ment and obtain the dense subgraph. In order to extract consistent feasible solutions from the LP 
even under the assumptions that fixed vertices belong to H, the LP relaxation will have a recursive 
structure similar to the Lovasz-Schrijver hierarchy jLS91j. Feasible solutions to this LP (when they 
exist) can be found in time (where the depth of the recursion will be roughly r), while the 

rest of the algorithm (given the LP solution) will take linear time. As we shall see, there is also 
a combinatorial variant of our algorithm, which, rather than relying on an LP solution, finds the 
appropriate set of leaves by exhaustive search (in time n r+ °^). While the analysis is essentially 
the same as for the LP variant, it is our hope that a mathematical programming approach will lead 
to further improvements in running time and approximation guarantee. 

The approximation ratio we achieve for general instances of DkS matches the "distinguishing 
ratio" we are currently able to achieve for various random settings. This suggests the following 
concrete open problem which seems to be a barrier for obtaining an approximation ratio of ra 1//4_e 
for DkS - distinguish between the following two distributions: 

T>\\ graph G picked from G(n, n~ 1//2 ), and 

T>2'- graph G picked from G(n, n" 1//2 ) with the induced subgraph on yfn vertices replaced 
with G( v / n,n" (1/4+e) ). 

In section [5] we will see that this distinguishing problem can be solved in time 2 n ° e , and this can 
be used to give an algorithm for DkS with approximation ratio ra 1 / 4-5 , and run time 2™ 0<£) . These 
mildly exponential algorithms are interesting given the recent results of [ABBG1Q] and [ABW08J, 
which are based on the assumption that planted versions of DkS are hard. 

In section [6l we show that in the random setting we can beat the log-density based algorithms 
for certain ranges of parameters. We use different techniques for different random models, some of 
which are very different from those used in sections [3] and SJ Interestingly, none of these techniques 
give a distinguishing ratio better than n 1 / 4 when k = D = yjn. 

1.2 Organization of paper 

In Section [21 we introduce some notation, and describe simplifying assumptions which will be made 
in later sections (some of these were used in |FKP01j ). In Section O we consider two natural 
'planted' versions of DkS, and present algorithms for these versions. The analysis there motivates 
our approximation algorithm for DkS, which will be presented in Section HJ In Section \5\ and 
Section [6l we explore approaches to overcome the log-density barrier that limits our algorithms in 
Section^ In Section [5] we give an 0(n 1//4_e ) approximation algorithm for arbitrary graphs with 
run time 0(2 n ° <e ) time, and in Section [6J we show that in various random settings, we can obtain 
a v^D-approximation (which is better than the log-density guarantee for 1 < D < y/n). 

2 Notation and some simplifications 

We now introduce some notation which will be used in the rest of the paper. Unless otherwise 
stated, G(V, E) refers to an input graph on n vertices, and k refers to the size of the subgraph we 
are required to output. Also, H will denote the densest /c-subgraph (breaking ties arbitrarily) in 
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G, and d denotes the average degree of H. For v G V, T(v) denotes the set of neighbors of v, and 
for a set of vertices 5C^, T(S) denotes the set of all neighbors of vertices in S. Finally, for any 
number x£K, will use the notation fr(x) = x — [x\. 

We will make the following simplifying assumptions in the remaining sections: (these are justi- 
fied in Section [A] of the appendix) 

1. There exists a D such that (a) the maximum degree of G is at most D, and (b) a greedy 
algorithm finds a /c-subgraph of density max{l, kD/n} in G. 

2. d is the minimum degree in H (rather than the average degree) 

3. It suffices to find a subgraph of size at most k, rather than exactly k. In Section [5] we use 
'/c-subgraph' more loosely to mean a subgraph on at most k vertices. 

4. When convenient, we may also take G (and hence H) to be bipartite. 

5. The edges of the graph G are assumed to be unweighted, since we can bucket the edges 
into O(logn) levels according to the edge weights (which we assume are all positive), and 
output the densest of the /c-subgraphs obtained by applying the algorithm to each of the 
graphs induced by the edges in a bucket. This incurs a loss of just O(logn) factor in the 
approximation. 

In many places, we will ignore leading constant factors (for example, we may find a subgraph of 
size 2k instead of k). It will be clear that these do not seriously affect the approximation factor. 

3 Random graph models 

An /(n)-approximation algorithm for the densest /c-subgraph problem must be able to distinguish 
between graphs where any /c-subgraph has density at most c, and graphs with an c/(n)-dense 
/c-subgraph planted in them. Random graphs are a natural class of graphs that do not contain 
dense /c-subgraphs. Further, random graphs seem to present challenges for currently best known 
algorithms for DkS. Hence, it is instructive to see what parameters allow us to efficiently solve this 
distinguishing problem. 

We consider three variants of the random distinguishing problem, in increasing order of difficulty. 
In the Random Planted Model, we would like to distinguish between two distributions: 

T>\\ Graph G is picked from G(n,p), with p = n a_1 , < a < 1. 

T>2'- G is picked from G{n,n a ~ l ) as before. A set S of k vertices is chosen arbitrarily, 
and the subgraph on S is replaced with a random graph H from G(k, k /3 ~ l ) on S. 

A slightly harder variant is the Dense in Random problem, in which we would like to distinguish 
between G chosen from D±, as before, and G which is chosen similarly to X>2, except that the planted 
subgraph H is now an arbitrary graph with average degree £r (that is, log-density (5). Here, the 
algorithm must be able to detect the second case with high probability regardless of the choice of 
H. 

Finally, we consider the Dense versus Random problem, in which we would like to distinguish 
between G ~ T>\, and an arbitrary graph G which contains a /c-subgraph H of log-density j3. 
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Observe that for G ~ T>±, a /c-subgraph would have expected average degree kp = kn a ~ l . 
Further, it can be shown that densest /c-subgraph in G will have average degree max{A;n a_1 , 1}, 
w.h.p. (up to a logarithmic factor). Thus if we can solve the distinguishing problem above, its 
'distinguishing ratio' would be min^(/c' 3 / max{/cn a_1 , 1}), where /3 ranges over all values for which 
we can distinguish (for the corresponding values of k, a). If this is the case for all /3 > a, then (as 
follows from a straightforward calculation), the distinguishing ratio is never more than 

k a . f/nx 1 -" 

mm < — , k 



< n l-a 



1-a 



m&x{kn a 1 ,1} \\k 

= n a(1 " a) • min 

In this section we will only discuss the Random Planted Model and the Dense versus Random 
problem, while the intermediate Dense in Random problem is only examined in Section [6l 



3.1 The random planted model 

One easy way of distinguishing between the two distributions in the Random Planted Model involves 
looking at the highest degree vertices, or at the pairs of vertices with the largest intersection 
of neighborhoods. This approach, which is discussed in Section [6] is not only a distinguishing 
algorithm, but can also identify H in the case of G ~ T>2- However, it is not robust, in the sense 
that we can easily avoid a detectable contribution to the degrees of vertices of H by resampling the 
edges between H and G \ H with the appropriate probability. 

Rather, we examine a different approach, which is to look for constant size subgraphs H' which 
act as 'witnesses'. If G ~ T>\, we want that w.h.p. G will not have a subgraph isomorphic to H', 
while if G ~ T>2, w.h.p. G should have such a subgraph. It turns out that whenever f3 > a, such 
an H' can be exists, and thus we can solve the distinguishing problem. 

Standard probabilistic analysis (cf. [AS08] ) shows that if a graph has log-density greater than 
r/s (for fixed integers < r < s) then it is expected to have constant size subgraphs in which the 
ratio of edges to vertices is s/(s — r), and if the log-density is smaller than r/s, such subgraphs are 
not likely to exist (i.e., the occurrence of such subgraphs has a threshold behavior). Hence such 
subgraphs can serve as witnesses when a < r / s < (3. 

Observe that in the approach outlined above, r/s is rational, and the size of the witnesses 
increases as r and s increase. This serves as intuition as to why the statement of Theorem 11.21 
involves a rational number r/s, with the running time depending on the value of r. 



3.2 Dense versus Random 

The random planted model above, though interesting, does not seem to say much about the gen- 
eral DkS problem. In particular, for the Dense versus Random problem, simply looking for the 
occurrence of subgraphs need not work, because the planted graph could be very dense and yet not 
have the subgraph we are looking for. 

To overcome this problem, we will use a different kind of witness, which will involve special 
constant-size trees, which we call templates. In a template witness based on a tree T, we fix a 
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small set of vertices U in G, and count the number of trees isomorphic to T whose set of leaves is 
exactly U. The templates are chosen such that a random graph with log-density below a threshold 
will have a count at most poly-logarithmic for every choice of U, while we will show by a counting 
argument that in any graph (or subgraph) with log-density above the same threshold, there exists 
a set of vertices U which coincide with the leaves of at least n e copies of T (for some constant 
e > 0). As noted in Section we may assume minimum degree k 13 in H as opposed to average 
degree (this will greatly simplify the counting argument). 

As an example, suppose the log-density is 2/3. In this case, the template T we consider is the 
tree s (a claw with three leaves). For any triple of vertices U, we count the number of copies 
of T with U as the set of leaves - in this case this is precisely the number of common neighbors of 
the vertices in U. In this case, we show that if G ~ T>x, with a < 2/3, every triple of vertices has 
at most O(logn) common neighbors. While in the dense case, with (3 = 2/3 + e, there exists some 
triple with at least k e common neighbors. Since for ranges of parameters of interest k £ = w(logn), 
we have a distinguishing algorithm. 

Let us now consider a log-density threshold of r/s (for some relatively prime integers s > r > 0). 
The tree T we will associate with the corresponding template witness will be a caterpillar - a single 
path called the backbone from which other paths, called hairs, emerge. In our case, the hairs will 
all be of length 1. More formally, 

Definition 3.1. An (r, s)- caterpillar is a tree constructed inductively as follows: Begin with a 
single vertex as the leftmost node in the backbone. For s steps, do the following: at step i, if the 
interval [(i — l)r/s,ir/s] contains an integer, add a hair of length 1 to the rightmost vertex in the 
backbone; otherwise, add an edge to the backbone (increasing its length by 1). 

This inductive definition is also useful in deriving an upper bound on the number of (r, s)- 
caterpillars in G(n,p) (for p < n r / s ~ l ) with a fixed sequence of 'leaves' (end-points of the hairs) 
vq,vi, . . . ,v r . We do this by bounding the number of candidates for each internal (backbone) 
vertex, and showing that with high probability, this is at most O(logn). We begin by bounding 
the number of candidates for the rightmost backbone vertex in a prefix of the (r, s) caterpillar (as 
per the above inductive construction). For each t = 1, . . . , r, let us write S VOr .. iV , tr ,, (t) for the set 
of such candidates at step t (given the appropriate prefix of leaves). The following claim upper 
bounds the cardinality of these sets (with high probability). (Recall the notation fr(x) = x — \_x\.) 

Claim 3.2. In G(n,p), for p < n r l s ~ l , for every t = 1, . . . , s and for any fixed sequence of vertices 
Ui = vo, . . . , v\ tr / s \ , for every vertex v G V \ XJ{ we have 

Pr[ve S VOj ..., VLtr/si (*)] < nW^Hl + o(l)). 

Intuitively, the claim follows from two simple observations: (a) For any set of vertices S C V 
in G(n,p), w.h.p. the neighborhood of S has cardinality at most pralS*! (since the degree of every 
vertex is tightly concentrated around pn), and (b) for every vertex set S, the expected cardinality 
of its intersection with the neighborhood of any vertex v is at most E[|<Sn r(u)|] < p\S\. Applying 
these bounds inductively to the construction of the sets S(t) when p = n r ^ s ~ 1 then implies \S(t)\ < 

n fr(tr/s) £ or ever y f 

Proof (sketch). In fact, it suffices to show equality for p = n r / s ~ l (since for sparser random graphs 
the probability can only be smaller). More precisely, for this value of p, we show: 

Pr[« e S V0> „., Vltr/si (t)] = nMtr/.)-i (1 ± o(1)) _ 
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We prove the claim by induction. For i = 1, it follows by definition of G(n,p): Pt[v G 5^,(1)] = 
p = n r / s ~ 1 . For t > 1, assume the claim holds for i — 1. If the interval [(t — l)r/s,tr/s] contains 
an integer (for 1 < t < s it must be \(t — l)r/s~\), then S(t) = S(t — 1) n F(vrr t _i\ r / s -\). Thus, by 
definition of G(n,p) and the inductive hypothesis, 

Pr[v G S VOt ... tVLtr/si (t)] = p ■ Pr[v G ^ 0i ... it , L(t _ 1)r/sJ (t - 1)] 

= n r /- 1 n fr « t - 1 ) p /»)- 1 (l + (l)) 

= n fr(*r/-)-l(l± (l)). 

Otherwise, if the interval [{t — l)r/s,tr/s] does not contain an integer, then S(t) = T(S(t — 1)). In 
this case, by the inductive hypothesis, the cardinality of the set \S(t — 1)| is tightly concentrated 
around rfi^ t ~ l ' r ' s ' (using Chernoff-Hoeffding bounds). If we condition on the choice of all S(t') for 
t' < t, and S(t — 1) has (approximately) the above cardinality, then for every v not appearing in 
the previous sets, we have 

Pr[« G S V0 _ Vltr/sj (t)] = Pr[3u G S VOt ... )V[tr/si (t - 1) : (u,v) G E] 
= l-(l-p)\S(t-D\ 

= p\S(t - 1)|(1 - o(l)) since p\S(t - 1)| = o(l) 

= n r / s -V r «*- 1 ) r / s )(l±o(l)) 
= n fr(*r/«)-l(l± (l)). 

Note that a more careful analysis need also bound the number of vertices participating in 
S(t) n S(t') for all t' < t. Further, even in this case, tight concentration assumed above is only 
achieved when the expected size of the set is n^ 1 ). However, this is guaranteed by the inductive 
hypothesis, assuming r and s are relatively prime. □ 

Now by symmetry, the same bounds can be given when constructing the candidate sets in the 
opposite direction, from right to left (note the symmetry of the structure). Thus, once all the leaves 
are fixed, every candidate for an internal vertex can be described, for some t G [l,s — 1], as the 
rightmost backbone vertex in the tth prefix, as well as the leftmost backbone vertex in the (s — t)th 
prefix starting from the right. By Claim [3721 the probability of this event is at most 

n Htr/s)-l n H(s-t)r/s)-l^ + o( -q) = n -l^ + ^ 

Thus, since the (r, s)-caterpillar has s — r internal vertices and r + 1 leaves, it follows by standard 
probabilistic arguments that, for some universal constant C > 0, the probability that total number 
of caterpillars for any sequence of leaves exceeds (logn) s_r is at most (s — r)n r+1 n _c,loglogn , which 
is o(l) for any constants r, s. 

Now let us consider the number of (r,s)-caterpillars with a fixed set of leaves in a A;-subgraph 
H with minimum degree at least d = yfc( r + £ )/ s . I gnoring low-order terms (which would account for 
repeated leaves), the number of (r,s)-caterpillars in H (double counting each caterpillar to account 
for constructing it inductively once from each direction) is at least kd s (since it is a tree with s 
edges), whereas the number of possible sequences of leaves is at most k r+1 . Thus, the number 
of (r, s) caterpillars in H corresponding to the average sequence of r + 1 //-vertices is at least 
kd s /k r+1 = k r+£ /k r = k £ . Note that the parameters for the high probability success of the dense- 
versus-random distinguishing algorithm are the same as for the random planted model, giving, as 
before, an distinguishing ratio of (^(n 1 / 4 ) in the worst case. 
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4 An LP based algorithm for arbitrary graphs 



We now give a general algorithm for DkS inspired by the distinguishing algorithm in the Dense vs 
Random setting. For a graph G with maximum degree D = n r l s , we will use the (r, s)-caterpillar 
template, and keep track of sets S(t) as before. We then fix the leaves one by one, while maintaining 
suitable bounds on S(t). 

Let us start by describing the LP relaxation^] Taking into account the simplifications from 
Section [21 we define a hierarchy of LPs which is satisfied by a graph which contains a subgraph of 
size at most k with minimum degree at least d. This hierarchy is at most as strong as the Lovasz- 
Schrijver LP hierarchy based on the usual LP relaxation (and is possibly weaker). Specifically, for 
all integers t > 1, we define DkS-LP^G, A;, d) to be the set of n-dimensional vectors (yi,...y n ) 
satisfying: 





and 


(1) 








3{Vij 1 i,j G V} 


s.t. 




Vi 6 V 


^2 Vij> dyi 


(2) 




jer(i) 




Vi, j e V 




(3) 


Mi, j e V 


< yij <Vi<l 


(4) 


if t > 1, Vi e Vs.t. Vi ^0 


{yn/Vi,- ■ ■ ,Vin/yi} G DkS-LP 4 _i(G, k,d) 


(5) 



Given an LP solution {yi}, we write LP^ y .y(S) = Y^iesUi- When the solution is clear from 
context, we denote the same by LP(S'). We call this the LP-value of S. When the level in the 
hierarchy will not be important, we will simply write DkS-LP instead of DkS-LPt. A standard 
argument shows that a feasible solution to DkS-LP^G, k, d) (along with all the recursively defined 
solutions implied by constraint ©) can be found in time n 0<yt \ For completeness, we illustrate this 
in Appendix IB1 

Informally, we can think of the LP as giving a distribution over subsets of V, with yi being the 
probability that i is in a subset. Similarly can be thought of as the probability that both i,j 
are 'picked'. We can now think of the solution {yij/yi : 1 < j < n} as a distribution over subsets, 
conditioned on the event that i is picked. 

Algorithm outline. The execution of the algorithm follows the construction of an (r, s)-caterpillar 
We perform s steps, throughout maintaining a subset S(t) of the vertices. For each t, we perform 
either a 'backbone step' or a 'hair step' (which we will describe shortly). In each of these steps, we 
will either find a dense subgraph, or extend an inductive argument that will give a lower bound on 
the ratio ~LP(S(t))/\S(t)\. Finally, we show that if none of the steps finds a dense subgraph, then 
we reach a contradiction in the form of a violated LP constraint, namely LP(S(s)) > \S(s)\. 

4.1 The Algorithm 

Let us now describe the algorithm in detail. The algorithm will take two kinds of steps, backbone 
and hair, corresponding to the two types of caterpillar edges. While these steps differ in the 

2 The entire algorithm can be executed without solving an LP, by performing an exhaustive search for the best set 
of leaves, with running time comparable to that of solving the LP. We will elaborate on this later. 
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updates they make, both use the same procedure to search locally for a dense subgraph starting 
with a current candidate-set. Let us now describe this procedure. 



DkS-Local^, k) 

• Consider the bipartite subgraph induced on (S,T(S)). 

• For all k' = 1, . . . , k, do the following: 

— Let Ty be the set of k' vertices in T(S) with the highest degree (into S). 

— Take the mm{k' , vertices in S with the most neighbors in Ty, and 
let Hy(S) be the bipartite subgraph induced on this set and Ty. 

• Output the subgraph Hy(S) with the largest average degree. 



We will analyze separately the performance of this procedure in the context of a leaf-step and 
that of a hair-step. We begin by relating the performance of this procedure to an LP solution. 

Claim 4.1. Given a set of vertices S C V, and an LP solution {y{\ £ DkS-LP(G, k, d), let 
k' = [LP(r(5))]. Then DkS-Loca^S 1 , k) outputs a subgraph with average degree at least 



maxjlSI,. 

Proof. Note that by constraint (pQ), k' = [LP(r(5))] < k. Then in Procedure DkS-Local, the 
vertices in Ty must have at least X^'er(s) %'|r(i)n5'| edges to S: indeed, the summation ^ yj\T(j)n 
S\ can be achieved by taking Ylj^T k / ' I T ( j ) n S\ and moving some of the weight from vertices 
in Ty to lower-degree (w.r.t. S) vertices (and perhaps throwing some of the weight away). After 
choosing the mm{k' , \S\} vertices in S with highest degree, the remaining subgraph Hy(S) has 
average degree at least 

mm{k',\S\} 1 ^ itv-\ooi 
1 1 jer(s) 

This proves the claim. □ 

The backbone step in the algorithm first performs DkS-Local on the current S, and then sets S to 
be T(S). The following lemma gives a way to inductively maintain a lower bound on LP(S*(t)) 
assuming DkS-Local does not find a sufficiently dense subgraph. 

Lemma 4.2. Given S C V , and an LP solution {yi} for DkS-LP(G, k, d): for any p > 1 such that 
LP(5)/|5| > p/d, either DkS-Local(5, k) outputs a subgraph with average degree at least p or we 
have 

LP( r ( s)) > «m. 

p 

Proof. By the LP constraints @ and ([2]), we have 

E yj\m^s\> e E w=EE yij >dLP(s). 

jer(S) j&(S)ier(j)ns ieS jer{i) 
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By Claim I4TTI Dks-Local(5, k) outputs a subgraph with average degree at least dLP(S) / max{|S| , k'}, 
where k' = LP(r(<S)) (note that we are ignoring some roundoff error which will be negligible in the 
context of the algorithm) . 

If k' < \S\, then we are done, since by our assumption, dLP(S)/\S\ > p. Now suppose k' > \S\. 
The output graph has average degree at least dLP{S)/k' . If this is at least p, we are done. If not, 
k' > dLP(S)/p, and since k' = LP(r(5)), we get the desired result. □ 

Let us now consider a hair step. In this case, the algorithm performs DkS-Local on the current 
set, and then picks a vertex j S V to act as a "leaf. The new S is then set to equal SnT(j). The 
following lemmas prove that either DkS-Local finds a sufficiently dense subgraph, or we can pick j 
so as to inductively maintain certain bounds. Let us first prove a simple averaging lemma. 

Lemma 4.3. Let Xj, (1 < j < n) be reals in [0,1], with Y^j x j — Let Pj and Qj be some 
non-negative real numbers such that for some P,Q>0, 

J ^2 x jPj — Pj an d ~^2 x jQj < Q- (6) 

3 3 

Then there exists an j such that Pj > P/(2k) and Pj/Qj > P/(2Q). 

Proof. By our assumption x j{ p j ~ ^k) — p ~ = • Thus from ©, it follows that there exists 
an j such that Xj > and 



P P 

2k ~ 2Q 

This choice of j clearly satisfies the required properties. □ 



Lemma 4.4. Let SC^, and let {yi} G DkS-LP(G, k, d) be an LP solution (for which there exist 
corresponding {yij})- Then for any p>l, either DkS-Local(5', k) outputs a p-dense subgraph, or 
there exists some vertex j £ G, such that yj > 0, and 

d-LP/„.i(5) 
LPfeM|i £ y}(Sn T{j)) > and 

Proof. By constraints ([2]) of the LP we have 

E yj LP {y ij Miev } (SnP(j))= E W E E Va i (7) 

jer(S) jer(S) ier(j)ns ies jer(i) 

From Claim 14.11 it follows that if the subgraph found by DkS-Local has average degree less than 
p, we must have p > X)jer(s) VjWti) ^ &\/ max{|S|, k'}, or in other words 

E yj\P(j)nS\<pm a x{\S\,k'}<pm a x{\S\,k}. (8) 
Thus the lemma follows immediately from Lemma 14.31 and equations (J7J) and ©. □ 
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We now formally describe the algorithm. It takes as input a graph G, a parameter k, and {yi}, a 
solution to DkS-LP r+ 2(G, k, d). Throughout, a set S QV, and an LP solution {yi} are maintained. 



DkS-Cat^G, 




• Let So = V. 




• lor all t = 1, . . . , s, do tne Following: 




— For i > 1, let be the output of Procedure DkS-Local(Si_i 


,k). 


— If the interval [{t — l)r/s,tr/s] contains an integer, perform a 


hair step: 


(moose some vertex j< as m Lemma 14.41 (or for t = 1, choose 


any ji such 


that j/j-j > 0), and 




* Let 5 t = SU n T(j t ). 




* Replace the LP solution {y^} with {yij t /yj t i G V}. 




— Otherwise, perform a backbone step: 




Let St = T{St-i). 




• Output the subgraph Ht with the highest average degree. 





Note that since the "conditioning" (replacing y^s by yij/yj) in the hair steps is only performed 
r + 1 times, then by constraint ([5]), at every step of the algorithm {yi} satisfies DkS-LP(G, k, d). 

A combinatorial algorithm. Note that the only time the algorithm uses the LP values is in 
choosing the leaves. Thus, even in the absence of an LP solution, the algorithm can be run by 
trying all possible sequences of leaves (the analysis will still work by replacing the LP solution 
with the optimum — 1 solution). While this would take time 0(n r ) as opposed to linear time 
(for the LP-based rounding algorithm), this is comparable to the time needed to solve the LP. An 
interesting open question is if it is possible to avoid the dependence on r, the number of leaves. 

4.2 Performance guarantee 

The analysis is quite straightforward. We follow the various steps, and each time apply either 
Lemma 14.21 or Lemma 14.4^ as appropriate. Our main result is the following: 

Theorem 4.5. Let s > r > be relatively prime integers, let G be an undirected (bipartite) graph 
with maximum degree < D = n r l s , let {yi} G DkS-LP r ^.i (G, k, d) . and define 7 = m&x{Dk/n, 1}. 
Then if d' is the average degree of the subgraph found by DkS-Cat r;S (G, k, {yi}), we have 

max{d',7} = ft(d/£> (s ~ r)/s ). 

Note that when the log-density a of G is not rational, we can choose rational a < r/s < a + e for 
any small e > 0. We then still appeal to Theorem I4.5l as before, though the greedy algorithm might 
only return a subgraph of average degree 7' > ^/n £ . Thus, the loss in the approximation ratio is at 
most n £ . A fairly straightforward calculation shows that this implies a 0(n 1 / 4+e )-approximation 
in 0{n ^^ £ ^) time for all e > (including e = 1/logn). 
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Before going into the details of the proof, let us note the similarities between the algorithm and 
the random models discussed earlier. Recall that in the random case, the sets S(t) (corresponding 
to St in the algorithm) had cardinality tightly concentrated around n* r ( tr / s >. Similarly here, if we 
assume that k = n/D(= D( s ~' r )/ r ), and that d (the density of the subgraph implied by the LP) is 
at least pk r l s (for some p > 1), then we show (see Corollary 14. 7p that if until step t the algorithm 
has not found an f2(p)-dense subgraph, then the current candidate set satisfies 

LP(S t ) > p „ iT{tr/s) . s/r (k_Y itr/s) h{tr/s) 



\St\ \nj \D 

which will yield a contradiction after the final step (when t = s). 

One difficulty is that we avoid making the assumption that kD = n (which is possible, but 
would incur a 0(\/log n) loss in the approximation guarantee). Instead, we use the fact that the 
greedy algorithm finds a /c-subgraph with average degree 7 > max{l, Dk/n}. Specifically, we show 
that at step t of the algorithm, either a subgraph with average degree Q(p) has already been found, 
or the greedy algorithm gives the desired approximation (i.e. 7 > p), or we have the desired lower 
bounds on LP(S t ) and LP(S t )/\S t \. 

Notation. In what follows, we let p = d/(2D {s ^/ s ) denote the desired average degree of the 
output subgraph (up to a constant factor). We also write L t = [tr/s\. Note that the number of 
hair steps up to and including step t is precisely L t + I. 
We now state the main technical lemma. 

Lemma 4.6. Let s > r > be relatively prime integers, let G be an undirected (bipartite) graph 
with maximum degree at most D = n r / s , and let {yi} be a solution to DkS-LP r+ i(G, k, d). Let 
7 = m&x{Dk/n, 1}. For t = 1, . . . , s, let d' t be the average degree of the densest of the subgraphs 
found by DkS-Cat rjS (G, k, {yi}) up through step t. Then either 

max{<i[,7} = fl(p), 

or we have 



d l 

LP ^) ^ 2 L tp t-L t -l k L t > and 

LP(#) > d* 



(9) 



\S t \ ~ 2 L tjp t - 1 D t ~ L t ' 



The following simple corollary immediately implies Theorem 14.51 (by contradiction) when we 
take t = s. 

Corollary 4.7. In the notation of Lemma \4-6[ either max{d^, 7} = Q(d/D^ s ~ r ^ s ), or we have 

LP (St) 2*-L* r /"J 
ISA ~ L> fr (Vs) ' 
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Proof. 



LP(S t ) d* 

— FTTi — > 7Tf 1 i t By Lemma 

\S t \ ~ 2 L ^p t - 1 D t ~ L t 



d t ^ 2D ( s -r)/sy 



> 2 Lt p t D t-L t P>^ 

definition of p 



2 Lt D t-L t d t 



JJt-L t -t(s-r)/s JJtr/s-Lt 



□ 



Let us now proceed to the proof of Lemma 14,6 



Proof of Lemma \4- 6[ We prove by induction that if the algorithm does not find an £l(p) dense 
subgraphs in steps 1 through t, the lower bounds ([9]) hold. Assume that p > j(> 1) (otherwise we 
are done). 

For t = 1, the bounds hold trivially: If j\ is any vertex for which yj 1 > 0, then we have 
LP {yy /„ } (5i) > d (by constraint ©) and so LP(5i)/|5i| > d/|r(ji)| > d/Z>(> d/frD)), which 
is exactly what we need. 

Now assume the lemma holds for some 1 < t < s — 1. We will show it for t + 1, considering 
separately backbone and hair steps. 

First, suppose t + 1 is a backbone step. Then the interval [tr/s, (t + l)r/s] does not contain an 
integer, i.e. tr/s < L t + (s — r)/s. By Lemma [4~2l if LP(St)/\St\ > p/d then either the procedure 
DkS-Local(5f, k) produces a p-dense subgraph, or we have LP(S , t+ i) = LP(r(5f)) > dLP(St)/ p. 
In that case, since |<St+i| = |r(<Sf)| < -D|St|, the claim follows immediately from the inductive 
hypothesis. Thus it suffices to show that indeed LP(St)/\St\ > p/d. This follows from Corollary [471 
which gives 

LP(St) 2 l - Lt 2 f - Lt _ 2 t+1 ~ Lt p 

\S t \ ~ D tr / S - L * > D( s - r )/ s ~ d ' 

Now, suppose t + 1 is a hair step. Then the interval [tr/s, (t + \)r/s\ does contain an integer, 
i.e. tr/s > Lt + (s — r)/s. Assuming Procedure DkS-Local(St, k) does not return a subgraph with 
average degree at least p, by Lemma 14.41 there is some choice of vertex jVfi such that 



d-LP {yi } (S t ) 

d-LP {yi} (S t ) 
2p ■ maxjfc, \ St\} 

Thus, the required lower bound LP(Sf+i) follows from (fTUj) and the inductive hypothesis. If \St\ > k, 
the bound on LP(S t +i)/\S t +i\ similarly follows from (fTTj) and the inductive hypothesis. Thus, it 



LP fe t+1 /% +1 |ien( S *+i) = LF {y> H+1 /y H+1 \ieV}( S t n r 0't+i)) ^ ' and ( 10 ) 
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remains to show the required bound when \St\ < k. In that case, (jlip gives 

dLP(S t ) 



LP(S t+l )/\S t+1 \ > 



2pk 
d t+1 

> -j —f T T-j inductive hypothesis 



> nf Xl t ' , T 11 SmCe P > 7 

^ TT77TT-7 • — T-TT SmCe 7 ^ fcZ) / n 



- 2^V ' ^(mW^ SinC6 tr/s " Lt + (S " r)/s 

1 „ r/s 

> „r , 1 : • m — 77 , in • since D > n ' 



2 L t+ 1 p t - 




d t+l 






kLt+l 




D L t +l 


2 L *+V 


ry n L t +l 




D L t + 



2 L *+V 7 D*+ 1 -( z 't+ 1 ) ' 



Since Lt+i = Lt + 1, the bound follows. This concludes the proof. □ 

5 An n^ 1 / 4 ^^-approximation with 'mildly' exponential run time 

We will now consider an extension of our approach to the case when the log-density of the subgraph 
H is (slightly) less than the log-density of the host graph (a crucial case if one wants to go beyond 
n 1//4 -approximations). This is done at the expense of running time - we obtain a modification of 
our caterpillar-based algorithm, which yields an approximation ratio of 0(n^ 1 ~ £ ^' i ) approximation 
which runs in time 2 n ° e) . The main modification is that for each leaf, rather than picking an 
individual vertex, we will pick a cluster of roughly 0(n e ) vertices (which is responsible for the 
increased running time). The cluster will be used similarly to a single leaf vertex: rather than 
intersecting the current set with the neighborhood of a single vertex, we will intersect the current 
set with the neighborhood of the cluster (i.e., the union of all neighborhoods of vertices in the 
cluster) . 

Motivation. We now describe briefly why we could expect such a procedure to work (and why 
we need to look at sets of size roughly n 6 ). Suppose we are given a random graph G with log-density 
p. Let r/s denote a rational number roughly equal to p + 5 (for some small constant 5). Suppose 
we call an (r + 1) tuple of leaves 'special' if there is an (r, s) caterpillar 'supported' on it, in the 
sense of Section [321 Since r/s > p, most (r + l)-tuples of vertices are not special. 

The crucial observation is the following: say we pick a set S of vertices, and ask how many 
(r + 1) tuples from S are special. This number turns out to be 'large' (appropriately defined later) 
roug hly iff |5| > n s . Now suppose we had planted a random graph H on k vertices and log-density 
p — e in G. Further suppose 5 is such that k £+s <C n* 5 (since k is much smaller than n, we can 
always choose this so, by setting 5 to be a constant multiple of e). By the above claim, sets in H 
of size k e+s would have a 'large' number of special tuples (since r/s = (log-density of H) + e + 5). 
But this number, by choice is much smaller than n s , thus if there was no H planted, sets of size 
k e+s would not have many special tuples! 
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This gives a distinguishing algorithm which runs in time roughly ( fce +s)- Let us now develop 
the algorithm in detail, for arbitrary graphs. 

To simplify the presentation, we will not describe the LP setting here, but only consider the 
equivalent of the combinatorial algorithm described earlier ("guessing the leaves"). Due to the 
already large running time, this will make little difference in terms of efficiency. Before we introduce 
the algorithm and provide a sketch of the analysis, let us state the main result of this section: 

Theorem 5.1. For every e > 0, there is a randomized 0{2 n&e )-time algorithm which for every 
graph G with high probability finds a k-subgraph whose average degree is within O^ 1-5 - 1 / 4 ) of the 
optimum. 

Theorem l5.1l is an immediate corollary of the performance guarantee of the modified algorithm, 
which is as follows: 

Theorem 5.2. For every < e < \, and every < fi < 1, there is a randomized algorithm which 
for every instance of Dense k-Subgraph with k = n@ , finds a k-subgraph whose average degree is 
within Oin^ 1 "^ 1-6 ') of the optimum (with high probability). Moreover, this algorithm runs in 
time at most 

Let us see that Theorem 15.11 follows easily: 

Proof of Theorem \5.1[ For e > 1/6, we can check every subgraph in time 2™ < 2™ 6c . Thus, we may 
assume that e < 1/6. Let k = nr, and consider separately two cases. First, suppose that /3 < 5/7. 
Note that the algorithm referred to in Theorem 15.21 always gives an 0(n( 1_£ )/ 4 )-approximation 
(regardless of j3). Thus we only need to bound the running time. For (3 < 5/7, the expression in 
the exponent is 

n 2pe/(20e+(l-P)) < n 2/3e/(l-/3) < n 2(5/7)e/(2/7) = _ 

Now consider /3 > 5/7. Using the reduction in Appendix IA.21 we may assume that D = n a 
for a < re 2 / 7 '. Algorithm DkS-Cat described in Section O (for rjs ~ a) already gives (in quasi- 
polynomial time) up to a constant factor an approximation ratio of at most 



D = n 



o(l-o) < n 10/49 < n (l-l/6)/4 < n (l-e)/4 



□ 



To simplify the analysis, we may perform additional preprocessing steps which will constrain 
the range of parameters: 

Lemma 5.3. For the purposes of finding an 0(n^ 1 ~ e ^ 4: ) -approximation for DkS, we may assume 
that the maximum degree of G is D = n/k, and that moreover, for a s.t. D = n a , the minimum 
degree in H is d = k a<yl ~^ for some < 5 < e. 

Proof (sketch). Let (3 be s.t. k = n@ . Then perform the following steps: 

1. If d > k 1 ^ 13 , prune the edges of G such that every edge is retained independently with 
probability (k x ~"/<£). 

2. Now let D' be the fc/2-largest degree in the pruned graph. 
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• If D'k < n, add to the current set of edges the edges of the random graph G(n, 1/k). The 
new edges cannot make more then a negligible contribution to the densest fe-subgraph. 

• Otherwise, if D'k > n, prune as in Appendix IA.2I 

Step 1 already guarantees that d < fc 1_/3 , and step 2 guarantees that the fc/2-largest degree in the 
final graph is approximately n/k. By Lemma lA.ll w.l.o.g. we can ignore the first k/2 vertices. It 
only remains to check that d is not too small (not less than /c^ 1- ^ 1- ^). Arguing as in Appendix lA.2( 
we may assume that if D'k > n then in the final graph we have d > n( 1_e )/ 4 = fc( 1-e )/( 4 ^) > 

In the modified algorithm, the backbone step and its analysis is the same as before. The main 
difference, as we mentioned, is in the leaf step. The following lemma (compare to Lemma l4.4p gives 
the guarantee of a leaf step when the current set is intersected with the neighborhood of a cluster 
as opposed to the neighborhood of a single vertex. 

Lemma 5.4. Let S C V, and let < C < k/2. Then for any p > 1, either DkS-Local(5, k) 
outputs a p-dense subgraph, or there exists some cluster of C vertices J C V(H), such that either 
we can extract a p-dense k-subgraph from the bipartite subgraph induced on (J, S n T(J)) in linear 
time, or we have 

'dC-\SnH\ 



\s n r(j) n h\ > n -j , and 

\snr(j)nH\ d-\SnH\ 



|5nr(J)| " \p 2 -max{k,\S\} 

Proof (sketch). The proof follows the same lines as that of Lemma 14.41 This gives similar bounds 
with respect to SjeJ nSnH\. An extra p factor is lost since the size of the set T( J) n S n H 
may be significantly less than the number of incoming edges from J. However, if it is more than a 
factor p less, then together with J it forms a /3-dense subgraph (and so a matching guarantee can 
be found by greedily picking highest J-degree vertices in S). □ 

We now present the modified algorithm. It takes as input a graph G with maximum degree at 
most n/k in which the densest fc-subgraph has minimum degree in the range 
where /3 is such that k = n° . These assumptions are valid by Lemma 15.31 
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DkS-Exp £ (G,/c) 

• Let a = 1 — /3 (so D = n a ). Let a' = a + 2/3e, and let < r < s < logn be 
integers such that \r/s — a!\ < 1/logn. Let C = n 2 /3 £ /( 2 ^ £ + a ) . Let Sq = V. 

• For all t = 1, . . . , s, do the following: 

— For t > 1, let i^t be the output of Procedure DkS-Local(S*f_i, k). 

— If the interval [(t — l)r /s,tr /s] contains an integer, perform a hair step: 
"Guess" a set Jt of C vertices and 

* Let St = St-inT(J t ). 

* Let H[ be the output of Procedure DkS-Local( Jt, k) run on the sub- 
graph of G induced on J t U St- 

— Otherwise, perform a backbone step: 
Let S t = r(5 t _i). 

• Output the subgraph Ht or H' t with the highest average degree. 



Note that guessing r clusters of size C correctly (such that they all satisfy Lemma 15, 4p takes 
time at most (™) r = 2°^ clo ^ n \ as required by Theorem EH The approximation guarantee is 
verified by showing that the algorithm finds a subgraph with density p = VL^d/k 01 ^ 1- ^). The proof 
runs along the same lines as Lemma 14.61 using a combination of Lemma 14.21 and Lemma 15.41 to 
prove the following lower bounds inductively (assuming no /3-dense subgraph is found): 

TT , d f C Lt+1 
\bt r) -n > — —7 — , and 

p l k Lt 

\S t nH\ d l 

> 



\S t \ pt+u D t-u- 
In particular, a simple calculation shows that the second bound implies 

\S t nH\ 1 
\S t \ > D tr /s-Lt 

which for t = s is a contradiction (indicating that a p-dense subgraph must have been found). 



6 Going beyond log-density in random models 

We now show that for a certain range of parameters, we can do better than the log-density bound 
in Section and later. Specifically, we show this for D < y/n (by the simplification in Section IA.21 
we can use this interchangeably with the condition k > y/n, which we will in this section). 



6.1 Improvements in the Random Planted Model 

In the easiest model, the Random Planted Model, if D < y/n (that is, p < l/y/n), then H is simply 
composed of the k vertices of highest degree in G whenever the expected average degree in H is 
3> \f\ag n\J~D (this is because with high probability, the minimum degree in H is considerably larger 
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than the standard deviation of degrees in G). This is an improvement over the log-density bound 
in this range which in the worst case gives a distinguishing ratio of D 1-Q . A similar argument using 
the standard deviation of intersections of neighborhoods gives an n 1 / 4 distinguishing ratio even for 
larger D, however for D > yfn it does not surpass the log-density barrier. 

6.2 Improvements for the Dense in Random problem 

We now show that in the Dense in Random problem, a simple eigenvalue approach does better than 
the log-density bound of Section 1531 for certain ranges of k and the average degree D. Suppose G is 
a random graph, with log-density p. In this case, the results of Section 13.21 allow us to distinguish 
random G from graphs which have a planted /c-subgraph of density 3> k p . 

Let us now consider the second eigenvalue of the input graph. If it were a random graph with 
log-density p, Fiiredi and Komlos [FK81j show that A2 < 0(n p / 2 ), w.h.p. Now suppose G contains 
a subgraph H on k vertices with min degree d 3> n p l 2 + Consider the vector x (in W n , with 
coordinates indexed by vertices of G) defined by 




1, if i € V(H) 
~T^k otherwise 



Note that x is orthogonal to the all-ones vectorjf] Further, if Aq is the adjacency matrix of G, we 
have that 

X T A G X _ J2(i,j)eE(G) X i X 3 

x T x ~ jfc + 

n—k 

kd-knP-^ d kn p 
~ 2k ~ 2 ~ ~n~ 

Thus if d ^> n p l 2 + we have A2 S> n p / 2 , and thus we can distinguish between the two cases. 
We can now compare this threshold for d to the one obtained by a log-density consideration (k p ). 
Thus when k ^> y/n, the A2-based algorithm does much better (i.e., it can solve the distinguishing 
problem for a smaller value of d). 



6.3 Improvements for Dense vs Random 

For the Dense vs Random question addressed in section 13.21 we consider a natural SDP relaxation 
for the densest k subgraph problem considered by [FS97], and show that this performs better than 
the algorithm presented earlier in the parameter range k > \fn. The SDP is as follows 

3 which we assume, is the eigenvector corresponding to Ai - this is not quite true, since the graph is not of uniform 
degree, but it turns out this is not a critical issue. 
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max Xij subject to (12) 

(i,j)eE(G) 

Y,X u = k (13) 

i 

^2x ij = kX ii for alii (14) 

3 

Xij < X u for all i, j (15) 
X y (16) 

This is a relaxation for the problem and it is easy to see that there exists an SDP solution of value 
\E(H)\, where H is a /c-subgraph. However we show that the SDP value for a random graph is 
upper bounded by exhibiting a suitable dual solution. 

Theorem 6.1. For a random graph G(n,p) of average degree D (D = np), the value of the SDP 
is at most k(y/~D + k 2 D/n) w.h.p. 

Proof, (of theorem I6.ip Let us consider the dual. We have the variables t (eq. PT3]) . yi (eq. [14"|) . Z{j 
(eq. fl~5"|) . The dual is 

min kt subject to 
U-A y 

Ua = t — kyi — z ij f° r an i 

j 

Uij = yi + for all i,j 

For a random graph, note that 

— J- A + X 2 I h 

n 

where J is the all-ones matrix (It is easy to see this considering two cases: the all ones vector, and 
vectors orthogonal to it). Hence if we set yi = — , t = A2 + — and the rest to 0, we get a feasible 
dual solution of value ^ + k\ 2 < k 2 ^ + k\[~D. 

In the last step, we used the fact that the second eigenvalue is at most yjnp w.h.p. □ 

As an immediate corollary, we have 

Corollary 6.2. The SDP lilty) can be used to distinguish between a G(n,p) random graph with 
average degree D = np and a graph with a k-subgraph of density \[D + kD/n. 

Note that the distinguishing guarantee in Corollary 16.21 is better than the log-density guarantee 
from Section [3.21 when k > \fn. 
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A Simplifications 



A.l Lossless Simplifications 

We present here a few simplifying assumptions which can be made with at most a constant factor 
loss in the approximation guarantee. We begin with a greedy algorithm which allows us to bound 
the maximum degree in G, taken from jl'Kl'Oll (Lemmas 3.2 and 3.3). 

Lemma A.l. There exists a polynomial time algorithm which, given a graph G containing a It- 
subgraph with average degree d, outputs a k-subgraph H' and an (n — k/ '2) -subgraph G' s.t. 

1. For some D > 0, G 1 has maximum degree < D and H' has average degree max{f2 (Dk/n), 1}. 

2. Either G' contains a k-subgraph with average degree £l(d), or H' has average degree £l(d). 

Proof. Let U be the set of k/2 vertices of highest degree in G (breaking ties arbitrarily), and let 
D = min ug [/ deg(-u). Let U' be the set of k/2 vertices of G of highest degree into U. Let H' be the 
graph induced on U U V. Observe that H' has Q,(Dk 2 /n) edges and average degree Q,(Dk/n) (it 
also has average degree at least 1, assuming G has at least k/2 edges). 

Now let G' be the subgraph induced onV\U (note that by definition, G' has maximum degree 
< D). Let H be the densest /c-subgraph in G, and let a be the fraction of edges of H that are 
incident with vertices of U. If a < 1/2, then the dk/2 of the edges in H remain in G' (and thus G' 
still has a fe-subgraph with average degree Q(d). On the other hand, if a > 1/2 then it is not hard 
to see that the H' must have average degree Q(d). □ 

We now justify the weakened requirement, that the algorithm should return a subgraph of size 
at most k (rather than exactly k). 

Lemma A. 2. Given an algorithm which, whenever G contains a k-subgraph of average degree £l(d) 
returns a k' -subgraph of average degree £l(d'), for some (non specific) k! < k), we can also find a 
(exactly) k-subgraph with average degree VL{d') for such G. 

Proof. Apply the algorithm repeatedly, each time removing from G the edges of the subgraph 
found. Continue until the union of all subgraphs found contains at least k vertices. The union 
of subgraphs each of average degree d' has average degree at least d'. Hence there is no loss in 
approximation ratio if we reach k vertices by taking unions of smaller graphs. Either we have not 
removed half the edges from the optimal solution (and then all the subgraphs found - and hence 
their union - have average degree Q(d')), or we have removed half the edges of the optimal solution, 
in which case our subgraph has at least dk/2 edges. 

Note that this algorithm may slightly overshoot (giving a subgraph on up to 2k vertices), in 
which case we can greedily prune the lowest degree vertices to get back a A;-subgraph with the same 
average degree (up to a constant factor). □ 

We now treat the assumption that G (and hence H) is bipartite (as in the rest of the pa- 
per, we define the approximation ratio of an algorithm A as the maximum value attained by 
|OPT(G)|/|A(G)|): 

Lemma A. 3. Given an f (n)- approximation for DkS on n-vertex bipartite graphs, we can approx- 
imate DkS on arbitrary graphs within a 0(/ (2n)) -factor. 
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Proof. Take two copies of the vertices of G, and connect copies of vertices (in two different sides) 
which are connected in G. Thus the densest 2£>subgraph in the new bipartite graph has at least 
the same average degree as the densest A;-subgraph in G. Now take the subgraph found by the 
bipartite DkS approximation on the new graph, and collapse the two sides (this cannot reduce the 
degree of any vertex in the subgraph). Note that the subgraph found may be a constant factor 
larger than k, in which case, as before, we can greedily prune vertices and lose a constant factor in 
the average degree. □ 

Finally, we note that it suffices to consider minimum degree in H, rather than average degree. 

Lemma A. 4. Approximation algorithms for DkS lose at most a constant factor by assuming the 
densest k-subgraph has minimum degree d as opposed to average degree. 

Proof. Let H be the densest fc-subgraph in G. Iteratively remove from H every vertex whose 
remaining degree into H is less than d/2. Since less than kd/2 edges are removed by this proce- 
dure, a subgraph on k! < k vertices and minimum degree at least d/2 must remain. As noted in 
Lemma lA.21 the fact that now we will be searching for subgraphs with k! ^ k vertices can affect 
the approximation guarantee by at most a constant factor. □ 

A. 2 Bounding the product kD 

It may simplify some of our manipulations if we can assume that kD < n. While we do not 
formally make this assumption anywhere, it is often instructive to consider this case for illustrative 
purposes. In fact, we can make this assumption, however at the cost of introducing randomness to 
the algorithm, and, more significantly, losing an 0{y/\og n) factor in the approximation guarantee. 

Assume that contrary to our assumption, D > n/k. In this case, take a random subgraph G' 
of G by keeping every edge with probability n/(kD). The new maximum degree D' now satisfies 
roughly D' = Dn/{kD) = n/k as desired. A standard probabilistic argument (involving the 
combination of a Chernoff bound and a union bound) shows that for every vertex induced subgraph, 
if d denotes its average degree in G, then its average degree in G' is at most 0((1 + dD' /D)(l + 
V%gn/(1 + dD'/D))). 

Let p be the approximation ratio that we are aiming at. For H, the densest fc-subgraph, we 
may assume that d > p-^/log nkD/n, as otherwise the greedy algorithm in Lemma lA.ll provides a 
P\/log n factor approximation. (This is where our argument loses more than a constant factor in the 
approximation ratio). Hence the average degree of H in G' is at least p-^/log n. An approximation 
algorithm with ratio p will then find in G' a subgraph of average degree at least y/log n. Such a 
subgraph must have average degree a factor of D/D' higher in G, giving an approximation ratio of 

P- 

B Solving the LP 

We will show that the linear program DkS-LP^G, k, d) can be solved in time by giving 

an equivalent formulation with explicit constraints which has total size (number of variables and 
constraints) n°w. We start by defining a homogenized version of the basic LP. We say that a 
vector (yi, . . . , y n , h) is a solution to DkS-hom t (G, k, d) if it satisfies: 
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Hi < kh, and 
h>0 

3{yij € s.t. 

Vie V ^ 2/»j- > dy* 

jer(») 

Vi,jev Vij = yji 

£V < j/ij <Vi<h 
if t > 1, Vz G V {yn, . . . ,y in ,yi} € DkS-hom t _i(G, k, d) 

Note now that the condition (yi, . . . , y n ) G DkS-LP t (G, A;, d) is now equivalent to (yi, . . . , y n , 1) G 
DkS-hom t (G, A;, d). Moreover, we can flatten out the recursive definition of DkS-hom t to give a fully 
explicit LP on n t+ °^ variables and n t+ °^ constraints, which can be solved in time by stan- 
dard techniques. 
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